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Abstract 

Social media and social networking sites have become a global pinboard for exposition and discussion of news, 
topics, and ideas, where social media users often update their opinions about a particular topic by learning from the 
opinions shared by their friends. In this context, can we learn a data-driven model of opinion dynamics that is able 
to accurately forecast users’ opinions? In this paper, we introduce SLANT, a probabilistic modeling framework 
of opinion dynamics, which represents users’ opinions over time by means of marked jump diffusion stochastic 
differential equations, and allows for efficient model simulation and parameter estimation from historical fine grained 
event data. We then leverage our framework to derive a set of efficient predictive formulas for opinion forecasting and 
identify conditions under which opinions converge to a steady state. Experiments on data gathered from Twitter show 
that our model provides a good fit to the data and our formulas achieve more accurate forecasting than alternatives. 


1 Introduction 

Social media and social networking sites are increasingly used by people to express their opinions, give their “hot 
takes”, on the latest breaking news, political issues, sports events, and new products. As a consequence, there has 
been an increasing interest on leveraging social media and social networking sites to sense and forecast opinions , 
as well as understand opinion dynamics. For example, political parties routinely use social media to sense people’s 
opinion about their political discourse 1 ; quantitative investment firms measure investor sentiment and trade using 
social media [17]; and, corporations leverage brand sentiment, estimated from users’ posts, likes and shares in social 
media and social networking sites, to design their marketing campaigns 2 . In this context, multiple methods for sensing 
opinions, typically based on sentiment analysis [20], have been proposed in recent years. However, methods for 
accurately forecasting opinions are still scarce [6, 7, 18], despite the extensive literature on theoretical models of 
opinion dynamics [5, 8]. 

In this paper, we develop a novel modeling framework of opinion dynamics in social media and social networking 
sites, SLANT 3 , which allows for accurate forecasting of individual users’ opinions. The proposed framework is 
based on two simple intuitive ideas: i) users’ opinions are hidden until they decide to share it with their friends (or 
neighbors); and, ii) users may update their opinions about a particular topic by learning from the opinions shared by 
their friends. While the latter is one of the main underlying premises used by many well-known theoretical models 
of opinion dynamics [5, 8, 21], the former has been ignored by models of opinion dynamics, despite its relevance on 
closely related processes such as information diffusion [11]. 

More in detail, our proposed model represents users’ latent opinions as continuous-time stochastic processes driven 
by a set of marked jump stochastic differential equations (SDEs) [13], Such construction allows each user’s latent 
opinion to be modulated over time by the opinions asynchronously expressed by her neighbors as sentiment messages. 
Here, every time a user expresses an opinion by posting a sentiment message, she reveals a noisy estimate of her 
current latent opinion. Then, we exploit a key property of our model, the Markov property, to develop: 

1 http://www.nytimes.com/2012/10/08/technology/campaigns-use-social-media-to-lure-younger-voters.html 

2 http://www.nytimes.com/2012/07/31/technology/facebook-twitter-and-foursquare-as-corporate-focus-g roups.html 

2 Slant is a particular point of view from which something is seen or presented. 
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I. An efficient estimation procedure to find the parameters that maximize the likelihood of a set of (millions of) 
sentiment messages via convex programming. 

II. A scalable simulation procedure to sample millions of sentiment messages from the proposed model in a matter 
of minutes. 

III. A set of novel predictive formulas for efficient and accurate opinion forecasting, which can also be used to 
identify conditions under which opinions converge to a steady state of consensus or polarization. 

Finally, we experiment on both synthetic and real data gathered from Twitter and show that our model provides a 
good fit to the data and our predictive formulas achieve more accurate opinion forecasting than several alternatives [6, 
7, 8, 14, 25], 

Related work. There is an extensive line of work on theoretical models of opinion dynamics and opinion formation [3, 
5, 8, 14, 16, 25]. However, previous models typically share the following limitations: (i) they do not distinguish 
between latent opinion and sentiment (or expressed opinion), which is a noisy observation of the opinion (e.g.. thumbs 
up/down, text sentiment); (ii) they consider users’ opinions to be updated synchronously in discrete time, however, 
opinions may be updated asynchronously following complex temporal patterns [11]; (iii) the model parameters are 
difficult to learn from real fine-grained data and instead are set arbitrarily, as a consequence, they provide inaccurate 
fine-grained predictions; and, (iv) they focus on analyzing only the steady state of the users’ opinions, neglecting 
the transient behavior of real opinion dynamics which allows for opinion forecasting methods. More recently, there 
have been some efforts on designing models that overcome some of the above limitations and provide more accurate 
predictions [6, 7], However, they do not distinguish between opinion and sentiment and still consider opinions to be 
updated synchronously in discrete time. Our modeling framework addresses the above limitations and, by doing so, 
achieves more accurate opinion forecasting than alternatives. 

2 Proposed model 

In this section, we first formulate our model of opinion dynamics, starting from the data it is designed for, and then 
introduce efficient methods for model parameter estimation and model simulation. 

Opinions data. Given a directed social network Q = (V,£), we record each message as e := ( u,m,t ), where the 
triplet means that the user u £ V posted a message with sentiment m at time t. Given a collection of messages 
{ei = ... ,e n = ( u n ,m n ,t n )}, the history H u (t) gathers all messages posted by user u up to but not 

including time t, i.e., 

T-Luit) = {e.j = = u and U < t}, (1) 

and H(t) := U U £vH u (t) denotes the entire history of messages up to but not including time t. 

Generative process. We represent users’ latent opinions as a multidimensional stochastic process x*(f), in which the 
u-th entry, x* (t) £ R, represents the opinion of user u at time t and the sign * means that it may depend on the history 
Hit). Then, every time a user u posts a message at time t, we draw its sentiment m from a sentiment distribution 
pim\x* u {t)). Here, we can also think of the sentiment m of each message as samples from a noisy stochastic process 
m u {t) ~ p{m u (t)\Xuit)). Further, we represent the message times by a set of counting processes. In particular, we 
denote the set of counting processes as a vector N (f), in which the w-th entry, -/V u (t) € {0} U Z + , counts the number 
of sentiment messages user u posted up to but not including time t. Then, we can characterize the message rate of the 
users using their corresponding conditional intensities as 

E[dN(t) | Hit)] = A*(f) dt, (2) 

where dN{t) := ( dN u (t) ) ueV denotes the number of messages per user in the window \t,t + dt) and A *(t) := 
( A* (t) ) M gv denotes the associated user intensities, which may depend on the history Hit). We denote the set of user 
that u follows by Afiu). Next, we specify the the intensity functions A *(t), the dynamics of the users’ opinions x*(i), 
and the sentiment distribution p(m|a;*(f)). 

Intensity for messages. There is a wide variety of message intensity functions one can choose from to model the 
users’ intensity A*(f) [1], In this work, we consider two of the most popular functional forms used in the growing 
literature on social activity modeling using point processes [9, 23]: 

I. Poisson process. The intensity is assumed to be independent of the history H it) and constant, i.e.. A* (i) = fi u . 
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II. Multivariate Hawkes processes. The intensity captures a mutual excitation phenomena between message 
events and depends on the whole history of message events U v e{ u uAf(u)}Hv(t) before t: 

X! bvu ^2 K ( t ~ t i)=Hu+ X! b vu (n(t)*dN v (t)), (3) 

•ugitUA f(u) ei£'Hv{t) vG. uUJ\f(u) 

where the first term, / i u f 0, models the publication of messages by user u on her own initiative, and the second 
term, with b vu f 0, models the publication of additional messages by user u due to the influence that previous 
messages posted by the users she follows have on her intensity. Here, k(£) = e vt is an exponential triggering 
kernel modeling the decay of influence of the past events over time and * denotes the convolution operation. 

In both cases, the couple (AT(£), A* (£)) is a Markov process, i.e., future states of the process (conditional on past and 
present states) depends only upon the present state, and we can express the users’ intensity more compactly using the 
following jump stochastic differential equation (SDE): 

d\*(t) = v(p - A *(t))dt + BdN(t), 

where the initial condition is A*(0) = //. The Markov property will become important later. 

Stochastic process for opinion. The opinion x* u (t) of a user u at time t adopts the following form: 

x* u (t) = a u + ^2 a vu ^2 mig(t-U) = a u + ^ a vu (g(t) * (m v (t)dN v (t))), (4) 

v€lN{u) eiGH v (t) v£Af(u) 

where the first term, a u £ R, models the original opinion a user u starts with, the second term, with a vu £ R, models 
updates in user u’s opinion due to the influence that previous messages with opinions rrij posted by the users u follows 
has on her opinion. Here, g(t) = e _w< denotes an exponential triggering kernel, which models the decay of influence 
over time. 

Under this form, the resulting opinion dynamics are Markovian and can be compactly represented by a set of 
coupled marked jumped stochastic differential equations (proven in Appendix A): 

Proposition 1. The tuple (x*(f), A*(f), N(t)) is a Markov process, whose dynamics are defined by the following 
marked jumped stochastic differential equations (SDE): 

dx*(t) = oj(ol — x*(t))dt + A(m(f) © dN(t)) (5) 

d\*(t) = v(p — \*(t))dt + BdN(t) (6) 

where the initial conditions are A*(0) = p and x*(0) = a, the marks are the sentiment messages m(f) = 
( tn u (t) ) ueV , with m u (f) ~ p(m\x^ (£)), and the sign © denotes pointwise product. 

The above mentioned Markov property will be the key to the design of efficient model parameter estimation and 
model simulation algorithms. 

Sentiment distribution. The particular choice of sentiment distribution p(m\x* u (£)) depends on the recorded marks. 
For example, one may consider: 

I. Gaussian Distribution The sentiment is assumed to be a real random variable m £ R, i.e., p(m\x u (t )) = 
A f(x u (t), <j u ). This fits well scenarios in which sentiment is extracted from text using sentiment analysis [12], 
II. Logistic. The sentiment is assumed to be a binary random variable m £ {—1,1}, i.e., p(m\x u (t)) = 1/(1 + 

exp(—m • x u (t))). This fits well scenarios in which sentiment is measured by means of up votes, down votes or 

likes. 

Our model estimation method can be easily adapted to any log-concave sentiment distribution. However, in the 
remainder of the paper, we consider the Gaussian distribution since, in our experiments, sentiment is extracted from 
text using sentiment analysis. 

2.1 Model parameter estimation 

Given a collection of messages 7 ~L(T) = {(u i; m*, £,;)} recorded during a time period [0, T) in a social network 
Q = (V, £), we can find the optimal parameters a, //, A and B by solving a maximum likelihood estimation (MLE) 
problem 4 . To do so, it is easy to show that the log-likelihood of the messages is given by 

4 Here, if one decides to model the message intensities with a Poisson process, B — 0. 
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message sentiments message times 

Then, we can find the optimal parameters (a, /z, A, B) using MLE as 

maximize C(ol, u, A.B ). AA 

a,fi>0,A,B>0 ' ' 

Note that, as long as the sentiment distributions are log-concave, the MLE problem above is concave and thus can 
be solved efficiently. Moreover, the problem decomposes in 2|V| independent subproblems, two per user u, since the 
first term in Eq. 7 only depends on (a, A) whereas the last two terms only depend on (//.. B), and thus can be readily 
parallelized. Then, we find (p,*,B*) using spectral projected gradient descent [4], which works well in practice 
and achieves e accuracy in 0(log(l/c)) iterations, and find (a. 1 '. A*) analytically, since, for Gaussian sentiment 
distributions, the problem reduces to a least-square problem. Fortunately, in each subproblem, we can use the Markov 
property from Proposition 1 to precompute the sums and integrals in (8) in linear time, i.e., 0{\H u (T)\ + | U v ^M(u) 
T~L V (T )|). Appendix H summarizes the overall estimation algorithm. 

2.2 Model simulation 

We leverage the efficient sampling algorithm for multivariate Hawkes introduced by Farajtabar et al. [10] to design 
a scalable algorithm to sample opinions from our model. The two key ideas that allow us to adapt the procedure 
by Farajtabar et al. to our model of opinion dynamics, while keeping its efficiency, are as follows: (i) the opinion 
dynamics, defined by Eqs. 5 and 6, are Markovian and thus we can update individual intensities and opinions in 0(1) 
- let ti and ti +1 be two consecutive events, then, we can compute A*(£j_|_i) as (A*(£j) — p) exp(—^(£,+i — U)) + p 
and x*(ti + i) as (x*(L) — a) exp(—w(f* + i — £,;)) + a, respectively; and, (ii) social networks are typically sparse and 
thus both A and B are also sparse, then, whenever a node expresses its opinion, only a small number of opinions and 
intensity functions in its local neighborhood will change. As a consequence, we can reuse the majority of samples 
from the intensity functions and sentiment distributions for the next new sample. Appendix I summarizes the overall 
simulation algorithm. 

3 Opinion forecasting 

Our goal here is developing efficient methods that leverage our model to forecast a user u’ s opinion x u (t) at time t 
given the history T~L(to) up to time £ (l </:. In the context of our probabilistic model, we will forecast this opinion by 
efficiently computing the conditional expectation E«(t)\«(t 0 ) [%u where T£(f)\"H(fo) denotes the average 
across histories from f 0 to £, while conditioning on the history up to H(to)- 

To this aim, we will develop analytical and sampling based methods to compute the above conditional expectation. 
Moreover, we will use the former to identify under which conditions users’ average opinion converges to a steady state 
and, if so, find the steady state opinion. In this section, we write Ht = 'H(t) to lighten the notation and denote the 
eigenvalues of a matrix X by £(X). 

3.1 Analytical forecasting 

In this section, we derive a set of formulas to compute the conditional expectation for both Poisson and Hawkes 
messages intensities. However, since the derivation of such formulas for general multivariate Hawkes is difficult, we 
focus here on the case when b vu = 0 for all v,u € G,v ^ u, and rely on the efficient sampling based method for the 
general case. 

I. Poisson intensity. Consider each user’s messages follow a Poisson process with rate //.„ . Then, the conditional 
average opinion is given by (proven in Appendix C): 

Theorem 2. Given a collection of messages 7~lt 0 recorded during a time period [0, to) and A* (t) = p u far all u £ Q, 
then, 

E Ut \n t0 [x*(t)\H t0 ] = + w(AA t - col)- 1 _ /) a> (9) 
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where Ai := diag[/u] and (x(t 0 )) ueV = a u + J2veM{u) a nv St iG W tl (t 0 ) e “ ( *° 

Remarkably, we can efficiently compute both terms in Eq. 9 by using the iterative algorithm by Al-Mohy et al. [2] 
for the matrix exponentials and the well-known GMRES method [22] for the matrix inversion. Given this predictive 
formula, we can easily study the stability condition and, for stable systems, find the steady state conditional average 
opinion (proven in Appendix D): 

Theorem 3. Given the conditions of Theorem 2, if Re[£(AAi)] < u>, then, 

( i i \ — 1 

I --) a. (10) 

W J 

The above results indicate that the conditional average opinions are nonlinearly related to the parameter matrix A, 
which depends on the network structure, and the message rates //, which in this case are assumed to be constant and 
independent on the network structure. Figure 1 provides empirical evidence of these results. 

II. Multivariate Hawkes Process. Consider each user’s messages follow a multivariate Hawkes process, given by 
Eq. 3, and b vu = 0 for all v, u £ Q, v / u. Then, the conditional average opinion is given by (proven in Appendix E): 

Theorem 4. Given a collection of messages TLt a recorded during a time period [0, to) an d A* (t) = p u +b uu X) e eu (t) e 
for all u € Q, then, the conditional average satisfies the following differential equation: 

dE n \ n [x*(t)\R to ] 

V °L = [-W/ + AA(t)]E nAHto [x*(t)\H to \ + cua, ( 11 ) 


where 

A(t) = diag (ll^ AWto [A*(i)|ft to ]), 

E nt \ nto [X*(t)\n t0 ] = 0 ) + n(B - uiy 1 V t > t 0 , 

(v(to))uev = du + buv 

v£Af(u) ti€'H v (to) 

B = diag([6 n,...,6 | V ||v|] T ) ■ 

Here, we can compute the conditional average by solving numerically the differential equation above, which is not 
stochastic, where we can efficiently compute the vector E^ ( [A* (f)] by using again the algorithm by Al-Mohy et al. [2] 
and the GMRES method [22]. 

In this case, the stability condition and the steady state conditional average opinion are given by (proven in Ap¬ 
pendix F): 

Theorem 5. Given the conditions of Theorem 4, if the transition matrix $(f) associated to the time-varying linear 
system described by Eq. 11 satisfies that || < f>(f)|| < i ye~ ct Vt > 0, where 7 , c > 0, then, 

( 1 i \ 1 

I -—-) a, (12) 

w J 


where A 2 


diag 


(I 



The above results indicate that the conditional average opinions are nonlinearly related to the parameter matrices 
A and B. This suggests that the effect of the temporal influence on the opinion evolution, by means of the parameter 
matrix B of the multivariate Hawkes process, is non trivial. We illustrate this result empirically in Figure 1. 


— I'(t — ti) 
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Figure 1: Opinion dynamics on two 50-node networks G \ (top) and G 2 (bottom) for Poisson (P) and Hawkes (H) 
message intensities. The first column visualizes the two networks and opinion of each node at t = 0 (positive/negative 
opinions in red/blue). The second column shows the temporal evolution of the theoretical and empirical average 
opinion for Poisson intensities. The third column shows the temporal evolution of the empirical average opinion for 
Hawkes intensities, where we compute the average separately for positive (+) and negative (—) opinions in the steady 
state. The fourth and fifth columns shows the polarity of average opinion per user over time. 


3.2 Simulation based forecasting 

Given the efficient simulation procedure described in Section 2.2, we can readily derive a general simulation based 
formula for opinion forecasting: 


E H t \H t 0 [x*(t)\nt 0 } « x*(t) = 


1=1 


(13) 


where n is the number of times that we simulate the opinion dynamics and x* (t) gathers the users’ opinion at time t 
for the Z-th simulation. Moreover, we have the following theoretical guarantee (proven in Appendix G): 

Theorem 6. Simulate the opinion dynamics up to time t > t$ the following number of times: 

n > ^ (6 ahox + 4x max e) log(2 /S ), (14) 

where <j'f nax = ma x ue g is the maximum variance of the users’ opinions, which we analyze in 

Appendix G, and x max > |x u (t)|, Vu £ Q is an upper bound on the users’ (absolute) opinions. Then, for each user 
u £ Q, the error between her true and estimated average opinion satisfies that |x* (t) — [a:* (f)|"Ht 0 ]| — e 

probability at least 1 — 5. 


4 Experiments 

4.1 Experiments on synthetic data 

We first provide empirical evidence that our model is able to produce different types of opinion dynamics, which 
may or may not converge to a steady state of consensus or polarization. Then, we show that our model estimation 
and simulation algorithms as well as our predictive formulas scale to networks with millions of users and events. 
Appendix J contains an evaluation of the accuracy of our model parameter estimation method. 

Different types of opinion dynamics. We first simulate our model on two different small networks using Poisson 
intensities, i.e., A *(t) = p u , p u ~ (7(0,1) Vrt, and then simulate our model on the same networks while using 
Hackers intensities with b vu ~ (7(0,1) on 5% of the nodes, chosen at random, and the original Poisson intensities 
on the remaining nodes. Figure 1 summarizes the results, which show that (i) our model is able to produce opinion 
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(a) Estimation vs # nodes (b) Simulation vs # nodes (c) Forecast vs # nodes (d) Forecast vs T 


Figure 2: Panels (a) and (b) show running time of our estimation and simulation procedures against number of nodes, 
where the average number of events per node is 10. Panels (c) and (d) show the running time needed to compute our 
analytical formulas against number of nodes and time horizon T = t — to, where the number of nodes is 10 3 . In 
Panel (c), T = 6 hours. For all panels, the average degree per node is 30. The experiments are carried out in a single 
machine with 24 cores and 64 GB of main memory. 

dynamics that converge to consensus (second column) and polarization (third column); (ii) the opinion forecasting 
formulas described in Section 3 closely match an simulation based estimation (second column); and, (iii) the evolution 
of the average opinion and whether opinions converge to a steady state of consensus or polarization depend on the 
functional form of message intensity 5 . 

Scalability. Figure 2 shows that our model estimation and simulation algorithms, described in Sections 2.1 and 2.2, 
and our analytical predictive formulas, described in Section 3.1, scale to networks with millions of users and events. 
For example, our algorithm takes 20 minutes to estimate the model parameters from 10 million events generated by 
one million nodes using a single machine with 24 cores and 64 GB RAM. 

4.2 Experiments on real data 

We use real data gathered from Twitter to show that our model can forecast users’ opinions more accurately than six 
state of the art methods [6, 7, 8, 14, 18, 25]. 

Experimental Setup. We experimented with five Twitter datasets about current real-world events (Politics, Movie, 
Fight, Bollywood and US), in which, for each recorded message i, we compute its sentiment value to,; using a popular 
sentiment analysis toolbox, specially designed for Twitter [12]. Here, the sentiment takes values m £ (—1,1) and we 
consider the sentiment polarity to be simply sign(m). Appendix K contains further details and statistics about these 
datasets. 

Opinion forecasting. We first evaluate the performance of our model at predicting sentiment (expressed opinion) at 
a message level. To do so, for each dataset, we first estimate the parameters of our model, SLANT, using messages 
from a training set containing the (chronologically) first 90% of the messages. Here, we set the decay parameters of 
the exponential triggering kernels n(t) and g(t) by cross-validation. Then, we evaluate the predictive performance 
of our opinion forecasting formulas using the last 10% of the messages 6 . More specifically, we predict the sentiment 
value to for each message posted by user u in the test set given the history up to T hours before the time of the 
message as to = We compare the performance of our model with the asynchronous linear 

model (AsLM) [7], DeGroot’s model [8], the voter model [25], the biased voter model [6], the flocking model [14], 
and the sentiment prediction method based on collaborative filtering by Kim et al. [18], in terms of: (i) the mean 
squared error between the true (to) and the estimated (to) sentiment value for all messages in the held-out set, i.e., 
E[(m — to) 2 ], and (ii) the failure rate, defined as the probability that the true and the estimated polarity do not coincide, 
i.e., P(sign(m) ^ sign(rh)). For the baselines algorithms, which work in discrete time, we simulate rounds in 
(t — T,t), where is the number of posts in time T. Figure 3 summarizes the results, which show that: (i) our 
opinion forecasting formulas consistently outperform others both in terms of MSE (often by an order of magnitude) 
and failure rate; 7 (ii) its forecasting performance degrades gracefully with respect to T, in contrast, competing methods 
often fail catastrophically; and, (iii) it achieves an additional mileage by using Hawkes processes instead of Poisson 
processes. To some extent, we believe SLANT’S superior performance is due to its ability to leverage historical data 
to leam its model parameters and then simulate realistic temporal patterns. 

^ For these particular networks. Poisson intensities lead to consensus while Hake’s intensities lead to polarization, however, we did find other examples in which 
Poisson intensities lead to polarization and Hawkes intensities lead to consensus. 

^Here, we do not distinguish between analytical and sampling based forecasting since, in practice, they closely match each other. 

^ The failure rate is very close to zero for those datasets in which most users post messages with the same polarity. 
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Figure 3: Sentiment prediction performance using a 10% held-out set for each real-world dataset. Performance is 
measured in terms of mean squared error (MSE) on the sentiment value, E[(to — to) 2 ], and failure rate on the sentiment 
polarity, P(sign(m) 7 ^ sign(m)). For each message in the held-out set, we predict the sentiment value rn given the 
history up to T hours before the time of the message, for different values of T. Nowcasting corresponds to T = 0 and 
forecasting to T > 0. The sentiment value m £ (—1,1) and the sentiment polarity sign (to) £ { — 1, !}• 



(a) Tw: Movie (Hawkes) (b) Tw: Movie (Poisson) (c) Tw: US (Hawkes) (d) Tw: US (Poisson) 


Figure 4: Macroscopic sentiment prediction given by our model for two real-world datasets. The panels show the 
observed sentiment 771 (f) (in blue, running average), inferred opinion x(t) on the training set (in red), and forecasted 
opinion ¥.^ t \ji t _ T [x u (t)\'Ht-T] for T = 1, 3, and 5 hours on the test set (in black, green and gray, respectively), 
where the symbol - denotes average across users. 


Finally, we look at the forecasting results at a network level and show that our forecasting formulas can also 
predict the evolution of opinions macroscopically (in terms of the average opinion across users). Figure 4 summarizes 
the results for two real world datasets, which show that the forecasted opinions become less accurate as the time 
T becomes larger, since the average is computed on longer time periods. As expected, our model is more accurate 
when the message intensities are modeled using multivariate Hawkes. We found qualitatively similar results for the 
remaining datasets. 

5 Conclusions 

We proposed a modeling framework of opinion dynamics, whose key innovation is modeling users’ latent opinions 
as continuous-time stochastic processes driven by a set of marked jump stochastic differential equations (SDEs) [13]. 
Such construction allows each user’s latent opinion to be modulated over time by the opinions asynchronously ex¬ 
pressed by her neighbors as sentiment messages. We then exploited a key property of our model, the Markov property, 
to design efficient parameter estimation and simulation algorithms, which scale to networks with millions of nodes. 
Moreover, we derived a set of novel predictive formulas for efficient and accurate opinion forecasting and identified 
conditions under which opinions converge to a steady state of consensus or polarization. Finally, we experimented 
with real data gathered from Twitter and showed that our framework achieves more accurate opinion forecasting than 
state-of-the-arts. 

Our model opens up many interesting venues for future work. For example, in Eq. 4, our model assumes a linear 
dependence between users’ opinions, however, in some scenarios, this may be a coarse approximation. A natural 
follow-up to improve the opinion forecasting accuracy would be considering nonlinear dependences between opinions. 
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It would be interesting to augment our model to jointly consider correlations between different topics. One could 
leverage our modeling framework to design opinion shaping algorithms based on stochastic optimal control [13, 24]. 
Finally, one of the key modeling ideas is realizing that users’ expressed opinions (be it in the form of thumbs up/down 
or text sentiment) can be viewed as noisy discrete samples of the users’ latent opinion localized in time. It would be 
very interesting to generalize this idea to any type of event data and derive sampling theorems and conditions under 
which an underlying general continuous signal of interest (be it user’s opinion, expertise, or wealth) can be recovered 
from event data with provable guarantees. 
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A Proof of Proposition 1 


Given x*(t) := [xi(t), at|y| (f)] T and A*(f) := [Ai(f),A|y|(f)] T , we can compactly rewrite Eqs. 3 and 4 for all 
users as: 

rt 


and 


x*(t) = a + A f g(t — 9)m(t) © dN(t) 

Jo 

A *(t) = n + B f n(t - 0) © dN(t). 

Jo 

Then, it easily follows that 

dx*(t) = A [ g'(t — 9)m(t) © dN(t) + g(0)Am(t) © dN(t), 
Jo 

where g(t) = e~ ut and c/(t — 0) = —ojg(t — 6). And, we can rewrite the above expression as 


Similarly, we can show that 


dx*(t) = uj(a — x*(t))dt + A(m(f) © dN(t)). 


d\*(t) = - A *(t))dt + B dN(t). 


(15) 


(16) 


(17) 


(18) 


B Auxiliary theoretical results 

The proofs of Theorems 2 and 5 rely on the following auxiliary Lemma. 

Lemma 7. The expected opinion E-^ t y^ [x* (f)\Ht 0 ] in the model of opinion dynamics defined by Eqs. 4 and 3 with 
exponential triggering kernels with parameters u> and v satisfies the following differential equation: 

dE Ut \ Ut [at* (t)\TLt 0 \ 

° dt =AE nAH Jx^t)Q\fft)\n t0 }^u J E ntXn Jx%t)\n t0 }+u Ja , (19) 

where A = (a vu )v,ueg an d the sign © denotes pointwise product. 

Using that E[m„(0)|a:* (0)] = x*(0), we can compute the average opinion of user u across all possible histories 
from Eq. 4 as 

E'H t \'Ht 0 \ x u^J)\JJto\ — ot u + 'y [ a uv 

veAf(u) 

-f* 'y' &u V ''y t 'y' o. uv 

VC:M(u) UeUvtto) v£N(u) 

and we can write the expectation of the opinion for all users in vectorial form as 

E 'H t \n t0 [x*(t)\ = v (t) + A.f g(t-6)E nmu [at*(0) © A*(0)]rf0, (20) 

JO 

where the © denotes pointwise product and 

( , u(t)) n OL u H - ^ ^ O'uv ^ ^ 9 ft t'i)TYl v {ti) • 

veAf(u) 

Since gft) = e~ ut , one may observe that uv(t) + v ft) = cua. Then, by differentiating Eq. 20, we obtain 
dE n \ n \x*(t) \H tQ \ 

A , = AE nAUto [at*(£) 0 - uE nAUto [x*(t)\H to ] + cua, (21) 


[ g(t - 0) E H(e) \ n [x* v {6)\* v {6)\H to \dO, 
a t 0 


g(t - 9 )E Ht \ n [m v ( 9 )dN v ( 9 )\n to } 
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C Proof of Theorem 2 

Using Lemma 7 and A* (f) = /i u , we obtain 

dEKt ^* (t)] = [-w/ + AAi]E« t [®* (£)] + wa, (22) 

where A-| = diag[/x]. Then, we apply the Laplace transform to the expression above and obtain 

x(s) = [si + wl — AA 1 ] _1 a;(£o) + — [si + ul — AA^^a, 

s 

where we leverage the fact that, conditioning the prior history, the opinion is non-random, i.e., E^ t \ ^ [tc(£o) | H t ~] = 

0 t Q 0 

x(to). Finally, applying the inverse Laplace transform, we obtain the average opinion E^ t y^ [ x *(t)\‘Ht 0 ] i n time 
domain as 

E nt \ nto [x*(t)\H to ] = e (^ A i-^)(*-‘o) a .( to ) +u {aA 1 - col )- 1 _/) ] a . 

D Proof of Theorem 3 

Theorem 2 states that the average users’ opinion E^ t [tc*(£)] in time domain is given by 

E nt \ nto [x*(t)\H to ] = ) x (t 0 ) + uiAAi - ul )- 1 _/) ] a . 

If f?e[£(AAi)] < u>, where £(X) denote the eigenvalues of matrix X, it easily follows that 

lim E% [x*(t)l = (i — 1 a. (23) 

t-Hx> y w ) 

E Proof of Theorem 4 

Assume b vu = 0 for all v, u £ Q,v ^ u. Then, A *(t) only depends on user v’s history and, since x*(t) only depends 
on the history of the user v’s neighbors Af(v), we can write 

E* t \ u t0 [**(*) © A*(i)|ft to ] = K nt \n t0 [**(*) |Wt„] © E nAUto [A*(f)], 

and rewrite Eq. 21 as 

d^n t \-H t0 [x*{t)\n t0 \ 

dt 

A ^Ut\Ht 0 [»*(*)|^t 0 ] © E « t \«t 0 [A*(£)| Ht 0 ]) - uE Ht \ Hlo [x*(t)\H to ] + uia. 

We can now compute E^^y^ [A* (0)\Ht o \ analytically as follows. From Eq. 3, we obtain 

E « t \ Ht0 [A* (t) 1^] = V(t) + I * Bn(t - 9)^n e \n tQ [A* (9)] d9, (25) 

Jt 0 

where «(f) = e~" t , [r}(t)] ueV = fi u + 'E v eAT(u) b uv Et ie «„(t 0 ) ~ **) and B = ( b vu)v,uev > where b vu = 0 for 

all v / u, by assumption. Differentiating with respect to t, we get, 

|e HtXHtQ [A*(£)|'Ht 0 ] = -vEm^o [A* {t)\H to \ + BE* AWto [A*(f)|% 0 ] + vp, 
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with initial condition E^ t +A* (to) = T)(to). By taking the Laplace transform and then applying inverse Laplace 
transform. 


e«A « t0 [A*(t)|ft t0 ] = e^W-^rjito) + v{B - uiy 1 (>—0(*-*o) _ j) ^ Vf > * 0 , 


(26) 


where rj(t 0 ) = E n(t + m(to) [A* (f 0 )]. Using Eqs. 24 and 26, as well as E n t \H t0 [x* {t)] © E W(VHto [A *(£)] = 

A W E «A«t 0 [**(*)]> where A W := dia s[ E « f \« t0 t A * (*)]]’ we obtain 


dE «A« t0 [**(*)] 


dt 


= [~ul + AA{t)]E nAHto [x*(£)] + ojcx, 


with initial conditions ( E w(t + ) \ w(to) [**(t 0 )]) ue v = a u + EveAT(u) a uv Et lG «„(*o) - L)m„(L)- 

F Proof of Theorem 5 

Theorem 4 states that the average users’ opinion [®*(f)] in time domain is given by 

dE Ut \H t0 [x*{t)\TL to ] 


dt 


= + AK{t)]E Ut \ nto [x*{t)\n to }+^OL. 


(27) 


In such systems, solutions can be written as [15] 

E H t \n t0 [x* (t) | H to ] = $(£)« + w [ ${s)ads, 

Jo 

where the transition matrix $(£) defines as a solution of the matrix differential equation 

4>(f) = [—w/ + AA(t)]$(f) with $(0) = I. 

If $(£) satisfies | |$(f) 11 < 7 e~ ct \/t > 0 for 7 , c > 0 then the steady state solution to Eq. 28 is given by [15] 


(28) 


-1 


a. 


where A 2 = lirn^oo A(f) = diag 


I — — 


i -1 


fi. 


G Proof of Theorem 6 


Let {at*(£)}]L 1 be the simulated opinions for all users and define s(t) = - E"=i where si(t) = (x*(t) — 
E H t \H ta Clearly, for a given t, all elements in Si(t) are i.i.d. random variables with zero mean and 

variance, and we can bound |s„(f)| < 2x max . Then, by Bernstein’s inequality, the following holds true. 


/ OTIC 

p (M*)l > e) = p (s«(£) > e)+F(s u (t) < -e) > 2.exp( - — - . - 

V &a U t \UtS uVdWo) + 4 *maxe 

Let O'max(i) = max „ e0 o-UtXnt «(*)l^t 0 )- If we choose, 


5 < 2 .exp^ — 


3 ne 2 


6 cr max0) + 4a: max^ 


(29) 


we obtain the required bound for n. Moreover, given this choice of 6, we have P(|s u (f)| < e) > 1 — 6 immediately. 

However, a finite bound on n requires the variance cr‘^ ax (t) to be bounded for all t. Hence, we analyze the variance 
and its stability below. 
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G.l Dynamics of variance 


In this section we compute the time-domain evolution of the variance and characterize its stability for Poisson driven 
opinion dynamics. A general analysis of the variance for multidimensional Hawkes is left for future work. 

Lemma 8 . Given a collection of messages recorded during a time period [0, to) and A* (t) = p u for all u € Q, 

the covariance matrix r(to, t) at any time t conditioned on the history l~l to can be described as, 

vec(T(t 0 ,t)) = [ $(t - 0)vec{(j 2 AAA T + AA\&g{E Ut _[x* {9)]f AA T ]d6. 

Jo 


where 

^cu/+AA)0/+/0(—AA) + (A(g)A)t 

Aj 2 ^2 = A*(i), and A := diag[A]. Moreover, the stability of the system is characterized by 


£[(-wJ + AA) <g> I + I <g> {-uil + AA) + {A <g> A)A] < 0. 


Proof. By definition, the covariance matrix is given by 

r(f 0 ,f):=E WAWt J(x*(f)-E WAWto (x*(f)))(a ; *(f)-E WAWto (a ; *(f))) T |^ to ]. (30) 

Hence, if we define Ate = (x* (t) — E- HA - HfQ ( x * (t))), we can compute the differential of the covariance matrix as 

dT(t 0 ,t) = ^n t \'H to [d{AxAx T )\'H to ] = E nAntQ [Axd{Ax T ) + d{Ax)Ax T + d(Ax)d(Ax T )\H to ], (31) 

where 

d(Ax) = d(x*{t) - E UAHto (x*(t))) = d(x*(t)) - d{E UAHtQ (x*(t))). (32) 

Next, note that 


E(d.N(t)dN T (t)) = E[dN i (t)dN j (t)] ilj& , = E[diag(dIV(£))] = A, (33) 


where the off-diagonal entries vanish, since two jumps cannot happen at the same time point [13]. Now, recall the 
Markov representation of our model, i.e., 


dx* (t) = —cox* ( t)dt + AM* (■ t)dN (t) + adt, 
where M* (t) := diag[m(f)] is the diagonal formed by the sentiment vector and note that, 

m(t) QdN(t) = M*(t)dN(t) = diag [dN(t)]m(t), 


(34) 

(35) 


and, using Eq. 21, 

dE nAHto [x*(t)\H to } = -uE HtXHto [x*(t)\H to ]dt + AAE HtXHto [x*{t)\H to ]dt + utadt. 

Then, if we substitute Eqs. 34 and 36 in Eq. 32, we obtain 

d( Ax) = -w[**(i) - E nAntQ (x*(t)\n t0 )]dt + A[M*(t)dN(t) - AE* AWto (x* (t)\U to )dt]. 
As a result, we can write 

dT(to,t) = E HAHtQ [ - 2ojAxAx T dt + Ax({M*(t)dN(t) - AE Ht \ H (x* (t))dtf A T 

Term 1 

+ A{M*{t)dN{t) - AE nAntQ (x*(t))dt)Ax T 

+ A(M*(t)dN(t) - AE nAnto (x*(t))dt)(M*(t)dN(t) - AE nAUto (x*(t))dt) T A T \H to ], 

V -v- / 

Term 2 


(36) 

(37) 


(38) 
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where Term 1 gives 

E nt \ nto [Ax(M*(t)dN(t) - AE HAHto {x*{t))dt) T A T \U to ) 

= E « f \Wt c ) [A®(m*(t)-E WAWto (®* (f))df) T A T Adt (Using Eq. 35 and the fact that E[diag(d./V(f))] = A) 

= E n t \H tQ Aa;.E[(m*(t) -E nAUto {x*(t))) T A T \x{t),U to \ Adt 

= r(f 0 , t)Adt, 

and Term 2 gives 

E nt \ ntQ A[(M*(t)dN(t) - AE WAWto (**(t))dt)(Af*(t)dJV(t) - AE* AWto (x*(t))dt) T \H to ]A T 
= AE nAHto [M*(t)E(dN(t)dN T (t))M*(t)\H to ]A T + 0(dt 2 ) 

= AE HiAHtQ [M 2 (t)\H to \AdtA T (From Eq. 33) 

= A W 2 ! + diag(E « A « t0 (x(t) 2 )\H to ))AA T dt 
= A[<j 2 I + Tu{t 0 A) + diag[E nt \- Hto (x*(t)\U to )} 2 )\AA I dt. 

Hence, substituting the expectations above into Eq. 38, we obtain 

= - 2 wr(i 0) t ) + r(f 0 , t)AA T + AAT{to, t) ( 39 ) 

+ AT u (t)AA T + a 2 AAA T + Adiag(E* AWto [x* (t)\H to }) 2 AA T , 

Eq. 39 can be readily written in vectorial form by exploiting the properties of the Kronecker product as 

=V(t)vec(T(to,t))+vec(a 2 AAA T + Adia,g(E Ht \ nto [x*(t)\H to ]) 2 AA T ) 

where 

n 

V{t) = (-w/ + AA) ® / + 7 ® (-w/ + AA) + ^(AATi ® TP,), 

i=l 

Pi — [<ki] and 0 stands for the Kronecker product. Hence, the closed form solution of the above equation can be 
written as, 

vec(r(f 0 , t)) = f e v( - t ^ e) vec[a 2 AAA I + Adia,g{E n{e) \ H [x*(e)\ / H to ]) 2 AA T }d9. (40) 

Jo 

Moreover, the covariance matrix r(fo, £) is bounded iff 

Re [A[(-w7 + AA) 0 7 + 1 0 (-ul + AA) + {A 0 A)A]] < 0, 
where A := ^i=i APi 0 Pi. 

In this case, the steady state solution T = lim^^ r(f 0 , t) is given by 

—2uiT + TAA t + AAV + A diag(T) AA T + a 2 AAA + A diag(E« t _ [x*]) 2 AA T = 0. (41) 

that means lim^oo vec[T(fo, £)] is same as, 

vec(r) = [(-u>7 + AA) 0 7 + 70 (- w 7 + AA) T + (A 0 A)A ] -1 

x vec[a 2 AAA t + Adiag(a;J 0 ) 2 AA T ] (42) 

where x* = lim^oo E^ A ^ (x* {t)\Ht 0 ) ■ Finally, the variance of node it’s opinion at any time t is given by 

( x u (01 P-to ) = [r(£o,f)] u ,« = vec(P lt ) T vec(r(£ 0 , £)), 

where P u is the sparse matrix with its only (u, u) entry to be equal to unity. 
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H Parameter estimation algorithm 

H.l Estimation of a. and A 

Algorithm H.l summarizes the estimation of the opinion dynamics, i.e., a and A , which reduces to a least-square 
problem. 


Algorithm 1 Estimation of a and A 
1 : Input: 'Ht, G(V, E) , regularizer A, error bound e 

2: Output: a, A 
3: Initialize: 

4: IndexForV[l : |V|] = 0 
5: for i = 1 to \H{T)\ do 
6: T[ui](IndexForV[ui]) = (ti,Ui,rm) 

7: IndexForV[ui]++ 

8: for it € V do 
9: i = 0 

10 : S = T[u ] 

11: for v € J\f(u) do 

12: S =MergeTimes(S', T[v\) 

13: // Merges two sets w.r.t h, takes 0(\'H u (T)\ + \ U V £U( u ) 'H V (T)\) steps 

14: Xiast = 0 

15: has, = 0 

16: j = 0 

17: for i = 1 to 151 do 

18: // This loop takes 0(151) = 0(\'H u (T)\ + | U„ e ^(«) 'H«(T)|) steps 

19: (t v ,v,m v ) = S[i] 

20: tnow — ty 

21: if u = v then 

99 . — ry, „—02 (t n ow — ^last) 

23: j++ 

24: g[u](j, v) = *now 

25: Y[u](j) = m u 

26: else 

27: Know = ccia S te““ ( * now_tlast) + m v 

18: hast = tnow 

29: Xiast = X n ow 

30: // Estimation of (a, A) 

31: for u £ V do 

32: a =InferOpinionParams(y [«], A, g[u]) 

33: a u = a[l] 

34: A[*][u] = o[l : end] 
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Algorithm 2 InferOpinionParams(l' u , A, <j„) 

1 : a = numRows(g„) 

2: X = [l s g u ] 

3: Y = Y u 
4: L = X'X 
5: x = (A I + L)~ 1 X'Y 
6 : return x 


H.2 Estimation of (/it, B) 

The first step of the parameter estimation procedure for temporal dynamics also involves the computation of the 
triggering kernels, which we do in same way as for the opinion dynamics in Algorithm H. 1. In order to estimate the 
parameters, we adopted the spectral projected gradient descent (SPG) method proposed in [4]. 


Algorithm 3 Spectral projected gradient descent for and B„» 

1: Input: Hr, G(V, E) and B°», step-length bound a m ax > 0 and initial-step length abb £ (0, amax], error bound e and 
size of memory h 

2: Output: fi u , B„» 

3: Notation: 

x = B„.] 

/(*) = E ei e«(T) logA^(ti) - E u6 v So A «( t ) dT 

4: Initialize: 

k = 0 

5: while ||d fe || < e do 
6: oifc i min{o; m ax, 

7 : d k <- P c [xk - a k Xf u (xk)\ - x k 

8 : / 6 “ <- max{/“(a; t ), f u (x k - i), f u (x k - h )} 

9: a <— 1 

10 : while q k (x k + ad k ) > + voNf u {x k ) T d k do 

11: Select a by backtracking line-search; 

12: Xk+i t— Xk + adk 

13: Sk <— adk 

14: y k <r- aB k d k 

15: abb <— UkUk/sSy k 

16: k = k + 1 


I Model simulation algorithm 

We leverage the simulation algorithm in [10] to design an efficient algorithm for simulating opinion-dynamics. The 
two basic premises of the simulation algorithm are the sparsity of the network and the Markovian property of the 
model. Due to sparsity, any sampled event would effect only a few number of intensity functions, only those of the 
local neighbors of the node. Therefore, to generate the new sample and to identify the intensity functions that require 
changes, we need Of log |V|) operations to maintain the heap for the priority queue. On the other hand, the Markovian 
property allows us to update the rate and opinion in 0(1) operations. The worst-case time-complexity of this algorithm 
can be found to be 0(d max |H(T)| | V|), where d max is the maximum degree. 
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Algorithm 4 OpinionModelSimulation(T, //. 13. a ., A) 

1: Initialize the priority queue Q 

2: LastOpinionUpdateTime[l : |V|] = LastIntensityUpdateTime[l : |V|] = 0 
3: LastOpinionUpdateValue[l : |1/|] = a 
4: LastIntensityUpdateValue[l : |V|] = /x 
5: H( 0) 4— 0 

6: for u G V do 

7: t =SampleEvent(/x[u], 0, u) 

8: Q.insert! [t, u]) 

9: while t < T do 

10: %%Approve the minimum time of all posts 

11: [t 1 , u] = Q.ExtractMin() 

12: t u = LastOpinionUpdateTime[-u] 

13: = LastOpinionUpdateValue[w] 

14: x t ' n a[?x] + (xt u — 

15: LastOpinionUpdateTime[u] = t! 

16: LastOpinionUpdateValue[t(] = Xf 

17: m u ~ p(m\x u {t)) 

18: H(t') <— H(t) U (t, m u , u) 

19: %% Update neighbors' 

20: for Vo such that u v do 

21: t v = LastIntensityUpdateTime[o] 

22: At„ = LastIntensityUpdateValue[o] 

23: A^ 3— /x[o] + (A t v — ft[r])e w 4 tv ^ + B uv 

24: LastlntensityUpdateTimefo] = t' 

25: Lastlntensi tyUpdate Value [o] = At' 

26: t v = LastOpinionUpdateTime[o] 

27: Xt„ = LastOpinionUpdate Value [o] 

28: x t ' v <- a[o] + (®t„ — a[v])e _ “ (t_tt,) + A uv m u 

29: LastOpinionUpdateTime[w] = t' 

30: LastOpinionUpdateValue [o] = x t ' 

31: %%Sample by only effected nodes 

32: t+ =SampleEvent(Ai, (t'), t', v) 

33: Q.UpdateKeyfo, t+) 

34: t 4— t' 

35: return H(T) 


Algorithm 5 SampleEvent(A, t, v ) 

1: A = A, s <— t 

2 : while s < T do 
3: U ~ Uniform[0,1] 

4: s = S — 

5: A(s) 4— /i[o] + (A„(f) - /x[o])e -uj(s-t) 

6: d ~ Uniform[0,1] 

7: if dA < A then 

8: break 

9: else 

10: A = A(s) 

11: return s 
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J Experiments on Synthetic Data 


Parameter estimation accuracy. We evaluate the accuracy of our model estimation procedure on three types of 
Kronecker networks [19]: i) Assortative networks (parameter matrix [0.96,0.3; 0.3,0.96]), in which nodes tend to link 
to nodes with similar degree; ii) dissortative networks ([0.3, 0.96; 0.96,0.3]), in which nodes tend to link to nodes with 
different degree; and iii) core-periphery networks ([0.9,0.5; 0.5,0.3]). For each network, the message intensities are 
multivariate Hawkes, // and B are drawn from a uniform distribution (7(0,1), and a and A are drawn from a Gaussian 
distribution Af(n = 0,<r = 1). We use exponential kernels with parameters oj = 100 and v = 1, respectively, for 
opinions x* (f) and intensities A *(t). We evaluate the accuracy of our estimation procedure in terms of mean squared 
error (MSE), between the estimated and true parameters, i.e., E[(.x' — x) 2 ]. Figure 5 shows the MSE of the parameters 
(a, A), which control the Hawkes intensities, and the parameters (//. B), which control the opinion updates. As we 
feed more messages into the estimation procedure, it becomes more accurate. 



Avg. no. of events per node 



50 100 200 400 800 

Avg. no. of events per node 


(a) Temporal parameters, (ex, A) 


(b) Opinion parameters, (fi, B) 


Figure 5: Performance of model estimation for several 512-node kronecker networks in terms of mean squared error 
between estimated and true parameters. As we feed more messages into the estimation procedure, the estimation 
becomes more accurate. 
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K Twitter dataset description 

We used the Twitter search API 8 to collect all the tweets (corresponding to a 2-3 weeks period around the event date) 
that contain hashtags related to the following events/topics: 

• Politics: Delhi Assembly election, from 9th to 15th of December 2013. 

• Movie: Release of “ Avengers: Age ofUltron ” movie, from April 28th to May 5th, 2015. 

• Fight: Professional boxing match between the eight-division world champion Manny Pacquiao and the unde¬ 
feated five-division world champion Floyd Mayweather Jr., on May 2, 2015. 

• Bollywood: Verdict that declared guilty to Salman Khan (a popular Bollywood movie star) for causing death of 
a person by rash and negligible driving, from May 5th to 16th, 2015. 

• US: Presidential election in the United-States, from April 7th to 13th, 2016. 

We then built the follower-followee network for the users that posted the collected tweets using the Twitter rest API 9 . 
Finally, we filtered out users that posted less than 200 tweets during the account lifetime, follow less than 100 users, 
or have less than 50 followers. 


Dataset 

|V| 

\£\ 

\U{T)\ 

E[m] 

std[m] 

Tw: Politics 

548 

5271 

20026 

0.0169 

0.1780 

Tw: Movie 

567 

4886 

14016 

0.5969 

0.1358 

Tw: Fight 

848 

10118 

21526 

-0.0123 

0.2577 

Tw: Bollywood 

1031 

34952 

46845 

0.5101 

0.2310 

Tw: US 

533 

20067 

18704 

-0.0186 

0.7135 


Table 1: Real datasets statistics 


8 https://dev.twitter.com/rest/public/search 

9 https://dev.twitter.com/rest/public 
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